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IDENTIFYING  ABILITY  REQUIREMENTS  FOR  OPERATORS  OF 
FUTURE  AUTOMATED  AIR  TRAFFIC  CONTROL  SYSTEMS 


Introduction 

Computers  are  increasingly  being  designed  to  per¬ 
form  duties  previously  performed  by  a  human  (Simon, 
1987,  Majchrzak,  1988).  While  awaiting  the  changes 
likely  to  occur  in  employees’  jobs  as  a  result  of  such 
automation,  human  resource  managers  should  begin 
now  to  anticipate  the  impact  these  changes  may  have  on 
requirements  for  selecting  employees  to  operate  the 
more  automated  systems.  How  functions  are  allocated 
between  the  operator  and  the  automation  will  affect  the 
complexity  of  the  resulting  job  (Price  &  Pulliam,  1 988). 
In  some  mb'-  '"itomation  might  be  configured  to  make 
most  job-related  decisions,  leaving  the  employees  to 
function  primarily  as  monitors  of  system  performance. 
In  this  circumstance,  selection  requirements  for  opera¬ 
tors  might  be  lowered  because  the  complexity  of  job  tasks 
would  be  reduced.  In  other  jobs,  automation  might 
perform  the  repetitive  tasks  of  a  job,  and  allow  the 
employee  to  perform  more  of  the  creative  and  evaluative 
activities.  In  this  circumstance,  operator  selection  re¬ 
quirements  might  be  raised  because  the  complexity  of 
the  job  would  be  increased.  While  the  amount  of  auto¬ 
mation  of  any  particular  job  will  depend  on  the 
automation’s  efficiency  in  performing  the  associated  job 
functions,  some  degree  of  automation  is  likely  to  be 
introduced  in  most  jobs. 

Anticipating  how  increased  automation  will  affect  the 
procedures  used  to  select  new  employees  is  difficult  when 
the  role  of  automation  in  a  job  has  not  yet  been  defined. 
The  extent  of  any  job  changes  will  depend  in  part  on 
decisions  made  about  the  allocation  of  functions  be¬ 
tween  the  computer  and  the  human  operator.  Further¬ 
more,  for  complex  automated  systems,  system 
development  may  be  spread  over  a  period  of  years,  and 
job  elements  affected  by  automation  may  not  be  fully 
identified  until  close  to  implementation,  when  opera¬ 
tional  testing  is  underway.  Moreover,  last-minute  testing 
mav  result  in  changes  to  the  man-machine  interface  and 
operational  procedures,  influencing  the  degree  to  which 
certain  abilities  are  required  to  perform  a  job. 

Although  it  may  be  difficult  to  anticipate  how  auto¬ 
mation  will  affect  a  job,  it  is  advantageous  to  anticipate 
job  changes  well  in  advance  so  that  appropriate  selection 
criteria  can  be  identified  and  implemented  in  at  the  same 
time  as  operational  versions  of  automated  systems.  The 
Federal  Aviation  Administration  (FAA)  plans  to  intro¬ 


duce  increasingly  sophisticated  levels  ofautomation  into 
air  traffic  control  facilities  over  the  next  20  years  (U.  S. 
Department  of  Transportation,  1984,  1 989).  The  pur¬ 
pose  of  this  study  was  to  explore  a  method  for  identifying 
selection  requirements  for  the  Air  Traffic  Control  Spe¬ 
cialist  (ATCS)  occupation  in  anticipation  of  increased 
system  automation. 

Current  Environment  and  Proposed  Automation 

The  automation  currently  available  in  the  air  traffic 
control  (ATC)  system  notifies  a  controller  of  aircraft 
locations  and  provides  other  relevant  information.  The 
ATCS  makes  decisions  by  incorporating  information 
provided  by  the  current  automation  with  other  informa¬ 
tion  obtained  from  verbal  pilot  reports.  Traffic  Manage¬ 
ment,  supervisors,  and  other  controllers,  then  issues 
appropriate  instructions  and/oradvisories  to  pilots.  Thus, 
for  the  current  ATC  system,  automation  provides  some 
of  the  required  information  to  the  ATCS,  but  the 
controller  makes  all  the  decisions  and  performs  most  of 
the  operations  required  to  implement  and  communicace 
those  decisions. 

The  scope  and  sophistication  of  available  AT  C.  system 
automation  varies  across  different  types  of  facilities. 
Controllers  work  in  1  of  3  options  or  specialties:  en 
route,  terminal,  and  flight  service  station  (FSS).  FSS 
specialists  provide  services  to  pilots,  such  as  giving  weather 
briefings,  filing  flight  plans,  and  giving  navigational 
assistance  to  disoriented  pilots.  Some  automation  has 
already  been  introduced  into  FSS  facilities,  providing 
specialists  with  improved  weather  graphics  and  data  and 
flight  planning  services.  In  fact,  most  of  the  automation- 
related  job  changes  likely  to  affect  the  duties  of  the  FSS 
specialist  have  already  been  introduced  (U.  S.  Depart¬ 
ment  of  Transportation,  1978,  1980).  Hundreds  of 
small  FSS  facilities  are  being  consolidated  into  a  smaller 
number  of  automated  facilities  as  part  of  an  effort  that 
has  been  underway  since  1986.  Furtherenhancementsto 
the  weather  radar  system  and  other  automated  systems 
will  improve  the  quality  of  the  information  available  to 
the  FSS  specialist,  but  probably  will  not  result  in  signifi¬ 
cant  changes  in  the  way  that  specialists  manipulate  the 
available  information.  Because  we  perceive  that  FSS  job 
tasks  are  not  likely  to  change  soon,  this  paper  will  not 
address  the  selection  requirements  for  FSS  specialists. 
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En  route  and  terminal  ATCSs  ensure  the  separation 
ot  aircraft  by  using  information  about  the  speed,  direc¬ 
tion,  and  altitude  of  aircraft  to  formulate  clearances  and 
communicate  them  to  pilots.  Clearances  are  sets  of 
instructions  for  pilots,  designed  to  ensure  the  safe,  expe¬ 
ditious,  and  orderly  flow  of  traffic.  En  route  controllers 
ensure  the  separation  of  those  aircraft  traveling  between 
airports,  while  terminal  controllers  ensure  the  separation 
of  aircraft  approaching  or  departing  from  airports.  There 
are  2  types  of  terminal  controllers:  terminal  radar  ap¬ 
proach  and  departure  controllers,  who  use  radar  to 
separate  aircraft  converging  on  or  departing  from  an 
airport;  and  tower  cab  controllers,  who  control  traffic 
landing  at  or  taking  off  from  an  airport. 

Initial  stages  of  ATC  automation  in  the  form  of  the 
Initial  Sector  Suite  System  (ISSS;  U.  S.  Department  of 
T ransportation,  1 987)  to  be  introduced  prior  to  the  year 
2000  will  provide  en  route  controllers  with  new  consoles 
on  which  they  will  have  access  to  electronically  displayed 
flight  progress  data  and  other  information.  However,  the 
way  controllers  use  that  information  to  tormulate  and 
issue  clearances  will  not  change.  Intermediate  stages  of 
automation  in  the  form  of  the  Area  Control  Computer 
Complex  (ACCC)  will  introduce  decision  aids  that  will 
identify  potential  problems  in  a  strategic  time  frame, 
(i.e.,  15-20  minutes  before  occurrence)  or  through  the 
end  of  the  route  of  flight.  These  problems  include 
conflicts  between  2  or  more  aircraft,  aircraft  intrusions 
into  restricted  airspace,  and  aircraft  noncompliance  with 
flow  instructions.  Future  software  enhancements,  such 
as  Automated  En  Route  ATC  (AERA  2),  will  recom¬ 
mend  solutions  that  optimize  certain  criteria,  such  as 
pilot  preferences.  Other  automation  (Data  Link)  may  be 
introduced  during  this  time  to  assist  the  controller  hv 
transmitting  clearances  digitally  to  a  pilot,  thus  relieving 
the  controller  of  some  of  the  verbal  communications 
requirements. 

TheTerminal  Advanced  Automation  System  (TAAS) 
will  replace  many  of  the  current  terminal  air  traffic 
control  systems  bv  the  late  1990s.  Terminal  Air  Traffic- 
Control  Automation  (TATCA),  a  form  of  terminal 
automation  that  generates  recommended  actions  for 
terminal  radar  approach  controllers,  will  also  be  inte¬ 
grated  into  the  TAAS.  Roth  TAAS  and  TATCA  should 
be  introduced  by  the  year  2000.  Tower  cab  controllers 
will  also  have  automation  aids,  provided  as  part  of  the 
Tower  Control  Computer  Complex  (TCCC).  TCCCs 


will  be  installed  from  the  mid-1990s  to  approximately 
2005. 

Facility  consolidation  will  occur  with  the  introduc¬ 
tion  of  these  stages  of  automation.  Some  terminal  radar 
approach  control  facilities  will  be  consolidated  with  en 
route  centers  into  Area  Control  Facilities  (ACEs).  Other 
terminal  facilities,  based  on  geographical  proximity,  will 
be  grouped  and  combined  into  metroplex  control  facili¬ 
ties.  1  he  remaining  terminal  facilities  will  continue  to 
serve  individual  airports  as  local  control  facilities.  Even¬ 
tually,  as  en  route  and  terminal  radar  functions  arc 
consolidated,  the  duties  of  en  route  and  terminal  radar 
approach  controllers  are  likely  to  become  similar  through 
the  use  of  the  same  type  of  equipment  and  some  of  the 
same  procedures;  however,  terminal  radar  controllers 
will  use  tactical  procedures  more  often  than  will  the  en 
route  controllers.  The  job  of  the  tower  cab  controller  is 
likely  to  remain  distinct  from  that  of  the  radar  controller. 

Forecasting  the  Impact  of  Proposed  Automation 
Changes  on  Job  Functions 

The  introduction  of  the  stages  of  automation  de¬ 
scribed  above  will  eventually  reduce  the  amount  of 
manual  conflict  detection  performed  by  controllers,  the 
time  and  effort  needed  for  formulating  and  issuing  air 
traffic  control  clearances,  and  the  amount  of  verbal 
communications  and  coordination  required  with  air¬ 
craft  and  other  controllers.  The  planned  automation  will 
have  a  significant  impact  on  the  way  air  traffic  controllers 
perform  their  jobs  and  also  may  affect  the  abilities 
required  of  future  ATCSs. 

.Select ion  p roced  u  res  fo  r  fu  t  u  re  ATCS  s  m  u  s  t  be  d  e  vel  - 
oped  or  modified  if,  in  fact,  important  changes  do  occur 
in  ability  requirements  for  increasingly  automated  jobs. 
In  order  to  design  a  selection  system  appropriate  to  the 
changing  occupation,  it  is  first  necessary  to  identify  the 
tasks  that  ATCSs  will  perform  under  increasing  levels  of 
automation,  then  enumerate  the  abilities  that  will  b^ 
required  to  perform  those  tasks.  Tests  can  then  be 
identified  or  designed  to  assess  the  degree  to  which  job 
applicants  possess  the  abilities  identified  as  necessary  to 
perform  the  evolving  job. 

A  number  of  issues  must  be  considered  before  at¬ 
tempting  to  identify  the  abilities  required  to  perform 
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jobs  that  do  not  vet  exist.  One  issue  relates  to  the 
availability  of  job  task  information.  It  is  generally  ac¬ 
cepted  that  analyses  of  job  functions  should  take  place  as 
early  as  possible  (during  the  concept  stage)  in  the  system 
development  cycle  to  ensure  proper  consideration  in 
system  design  (Christensen,  1988).  Updates  to  job  task 
descriptions  should  occur  as  the  system  evolves.  How¬ 
ever,  because  the  automated  ATC  system  is  currently 
evolving  and  decisions  about  the  role  of  the  controller 
with  respect  to  the  automation  have  not  been  finalized, 
the  tasks  likely  to  be  performed  by  the  future  ATCS  can 
presently  only  be  described  in  a  general  way.  Some  of 
these  decisions  may  not  be  finalized  for  several  years; 
system  design  is  not  yet  complete,  and  controller  teams 
and  human  factors  studies  will  provide  feedback  to  the 
designers.  This  will  result  in  system  design  changes, 
which  may  occur  up  until  just  before  system  implemen¬ 
tation.  One  question  that  must  be  answered  in  this 
endeavor  is  “At  what  point  in  the  system  development 
cycle  for  a  particular  stage  of  automation  snouid  an 
analysis  occur  of  the  abilities  required  to  perform  the 
future  controller’s  job?" 

Another  related  issue  deals  with  the  evolution  of 
automation  enhancements.  Introduction  of  early  auto¬ 
mation  may  not  change  the  abilities  required  to  perform 
the  controller’s  job,  while  the  introduction  of  intermedi¬ 
ate  and  later  stages  of  automation  may  result  in  signifi¬ 
cant  changes  in  required  abilities.  The  relevant  question 
here  is  “At  what  stage  of  automation  should  the  organi¬ 
zation  plan  to  introduce  new  or  revised  selection  proce¬ 
dures?” 

Strategic  Job  Analysis 

Schneider  and  Konz  (1989)  discussed  a  technique 
called  strategic  job  analysis  to  assess  job  tasks  to  be 
performed  as  well  as  the  knowledges,  skills,  and  abilities 
(KSAs)  likely  to  be  required  to  perform  jobs  that  may 
change  as  a  result  of  increasing  automation.  The  process 
is,  in  some  ways,  similar  to  job  analyses  conducted  for 
existing  jobs.  Traditional  job  analyses  use  a  variety  of 
methods  to  elicit  information  about  tasks  performed  and 
the  frequency  and  criticality  of  performance  on  those 
tasks  from  individual  experts  who  perform  the  job,  called 
Subject  Matter  Experts  (SMEs;  efi,  Cornelius,  1988). 
Other  information,  such  as  the  abilities  required  to 
perform  the  tasks  (used  to  develop  selection  procedures), 
knowledges  and  skills  required  (when  developing  train¬ 
ing  programs  or  identifying  recruitment  strategics). 


working  conditions  and  hazards  (when  identifying  pay 
classifications),  may  also  be  obtained.  This  type  of  infor¬ 
mation  is  typically  based  upon  SME  judgments  because 
they  are  most  familiar  with  the  job  tasks  performed  and 
the  requirements  for  performing  those  tasks.  According 
to  Schneider  and  Konz’s  (1989)  approach,  after  the  job 
tasks  and  KSAs  have  been  identified  for  the  current  job, 
interviews  are  conducted  with  SMEs  to  identify  factors 
that  may  affect  a  job  as  it  is  expected  to  exist  in  the  future. 
The  tasks  and  KSAs  identified  for  the  current  version  of 
the  job  are  then  revised  in  light  of  the  expected  changes. 
Revisions  to  the  descriptions  for  the  future  job  should  be 
made  periodically  to  take  into  account  any  changes  in 
plans  that  might  have  occurred. 

This  process  may  be  more  difficult  to  implement  than 
it  would  appear.  Task  descriptions,  which  can  be  very 
detailed  for  current  jobs,  may  only  be  phrased  in  a 
genera!  way  for  jobs  that  do  not  exist,  or  even  if  they  are 
detailed,  may  change  considerably  as  the  specifications 
for  the  equipment  and  automation  evolve.  SMEs  who 
contribute  to  the  task  descriptions  can  be  very  certain 
about  how  they  perform  the  job  currently,  but  no  one, 
not  even  those  SMEs  who  have  been  closely  iinked  with 
the  development  of  automation  has  ever  performed  the 
job  using  the  future  automation.  Thus,  current  SMEs  do 
not  have  the  same  level  of  expertise  when  describing 
future  tasks. 


In  spite  of  the  potential  problems  with  this  approach, 
some  attempts  have  been  made  to  identify  the  ATC  tasks 
likely  to  change  as  a  result  of  the  introduction  of  different 
stages  of  system  automation.  CTA  Inc.,  derived  task, 
subtask,  and  task  element  descriptions,  as  w'dl  as  task 
information  requirements,  cognitive/sensory  attributes, 
and  performance  requirements  for  current  and  future 
ATC  systems  through  extensive  interactions  with  con¬ 
troller  teams  (Alexander,  Alley,  Ammerman,  et  al.,  1 988; 
Ammerman.  Becker,  Claussen,  Inman,  et  ah,  1987a; 
Ammerman,  Becker,  Claussen,  et  ah,  1987b). 


Ammerman  and  Jones  (1988)  then  compared  the 
tasks  of  the  current  en  route  controller  with  those  to  be 
performed  by  ATCSs  operating  ISSS  equipment.  They 
determined  that  when  transitioning  to  ISSS,  there  will  be 
little  change  in  the  results  or  output  generated  by  ATCSs, 
but  there  will  be  some  changes  in  how  they  perform  the 
duties  that  support  the  generation  of  that  output.  Tasks 
to  be  affected  most  included  those  associated  with  re¬ 
viewing  and  entering  flight  progress  data.  Also  affected 


Codes 


PALO  ^UA.UTY  cNSPECTISD  5 

3 


will  be  actions  dealing  with  adjusting  displays,  transfer¬ 
ring  control  responsibilities,  and  processing  of  control 
data  and  messages.  Phillips  ( 1 988)  expanded  this  discus¬ 
sion  to  address  tasks  and  skills  associated  with  the  pro¬ 
cessing  of  flight  progress  dafa  that  will  occur  when  the 
information  on  flight  progress  strips  is  automated  during 
1SSS  implementation.  He  proposed  that  the  greater 
flexibility  associated  with  manipulating  flight  progress 
data  using  ISSS  will  result  in  an  increased  emphasis  on 
skills  in  coding  and  sorting  information,  and  a  lower 
emphasis  on  physical  manipulation  of  flight  progress 
strips  as  a  memory  aid.  While  Phillips  (1988)  concluded 
that  some  changes  in  skills  would  occur  after  converting 
from  the  current  en  route  air  traffic  equipment  to  ISSS 
equipment,  he  suggested  that  major  changes  would 
probably  not  occur  in  the  underlying  abilities  required  to 
control  traffic.  Thus,  Phillips  (1988)  thought  that  new 
procedures  probably  need  not  be  developed  to  select 
ATCSs  who  will  operate  ISSS  equipment.  Due  to  changes 
in  the  ISSS  controller  interface  since  Phillips’  (1988) 
study,  it  may  be  necessary  to  reevaluate  the  required  job 
tasks  to  confirm  or  disconfirm  Phillips’  (1988)  predic¬ 
tions. 

Assessing  the  job  task  changes,  required  abilities,  and 
potential  need  for  different  selection  procedures  is  less 
easily  addressed  for  the  AERA  2  level  of  automation. 
While  considerable  documentation  is  available  about  the 
proposed  functions  of  the  AERA  levels  of  automation 
(e.g.,  Chambliss,  Walker,  Celio,  and  Sprague,  1990; 
Fordham,  1990;  Kulik  and  Burke,  1990),  not  as  much 
information  is  available  to  describe  in  detail  the  func¬ 
tions  of  the  human  in  relation  to  the  automation.  Carlson 
&  Rhodes  (1990)  compared  the  activities  involved  in 
detecting  and  resolving  an  aircraft  conflict  and  respond¬ 
ing  to  a  pilot  request  in  today’s  system  with  the  corre¬ 
sponding  activities  for  AERA  2.  They  did  not,  however, 
address  other  job  tasks  to  be  performed  by  the  AERA 
controller.  Celio  (1990)  provided  some  general  operat- 
ingguidelines  for  the  AERA  2  controller.  Celio,  McCabe, 
and  Schultheis  (1990)  provided  activity  sequences  and 
operatingguidelines  for  AERA  controllers  respondingto 
an  extensive  set  of  specific  scenarios.  The  activity  se¬ 
quences  described  the  operation  of  the  system  and  the 
controller’s  response  to  information  displayed  by  the 
system. 

Some  have  speculated  that  ability  requirements  may 
not  change  much  with  implementation  of  AERA  2 
(McKinley  and  Jago,  1984).  Other  assessments  of  pro¬ 


posed  automation  aids  suggest  that  the  skills  required  to 
maintain  the  “mental  picture”  of  the  air  traffic  situation 
may  be  used  less  frequently  when  the  automation  is 
assigned  the  role  of  identifying  most  of  the  potential 
conflicts  between  aircraft  (Whitfield,  Ball,  and  Ord, 
1980).  Hopkin  (1989)  proposes  that  the  use  of  auto¬ 
mated  problem  detection  could  lead  controllers  to  accept 
automation-generated  problem  resolutions  routinely. 
He  feels  that  controllers  will  either  know  less  about  how 
the  system  is  functioning  or  will  have  to  work  harder 
than  at  present  to  maintain  their  mental  picture.  If  these 
projections  were  true,  future  controllers  might  need  a 
different  set  or  mix  of  abilities  and  skills  to  maintain 
current  levels  of  situational  awareness,  and  thus,  selec¬ 
tion  requirements  might  be  changed. 

Study  Focus 

This  study  was  conducted  to  a)  clarify  the  description 
of  the  role  of  the  AERA  2  controller  with  respect  to 
several  AERA  2  controller  job  tasks,  b)  identify  the 
abilities  considered  likely  to  be  required  for  a  controller 
to  perform  tasks  using  the  AERA  2  system,  and  c) 
determine  the  differences  between  the  abilities  identified 
in  b)  with  those  required  for  the  current  system.  While 
the  AERA  2  level  of  automation  is  not  yet  finalized,  the 
results  of  this  study,  given  the  current  thinking  about 
AERA  2  system  functions,  should  allow  some  predic¬ 
tions  to  be  made  about  whether  modifications  to  current 
selection  procedures  should  be  considered. 

Method 

Subjects 

Subjects  were  members  of  the  Air  Traffic  AERA 
Concepts  Team  (ATACT).  At  the  time  of  the  study, 
ATACT  had  1 1  members,  9  of  whom  participated  in  the 
study.  The  other  2  members  did  not  attend  the  team 
meetings  during  which  the  study  was  conducted. 

ATACT  is  a  team  of  ATC  specialists  (including  a 
military  representative)  that  has  met  several  times  a  year 
since  1985  to  develop  and  analyze  AERA  2  operational 
requirements.  Through  discussions  and  laboratory  in¬ 
vestigations,  they  develop  and  review  AERA  specifica¬ 
tions  and  plans  from  the  perspective  of  air  traffic 
controllers.  Members  are  selected  for  their  operational 
expertise  as  well  as  their  diverse  backgrounds.  ATACT 
members,  ranging  in  age  from  approximately  30  to  50, 
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have  a  collective  experience  totaling  more  than  1 40  years 
of  ATC  wotked  in  FAA  centers,  CERAPs,  TRACONs, 
and  towers  throughout  the  United  States,  plus  some 
military  and  foreign  facilities.  Additionally,  they  repre¬ 
sent  more  than  35  years  of  staff  (training,  traffic  manage¬ 
ment,  data  systems,  procedures)  and  25  years  of 
supervisory  experience.  Most  members  have  flying  expe¬ 
rience  (private,  instrument,  instructor,  commercial,  com¬ 
bat,  and  air  transport)  and  some  have  computer 
programming  and  data  systems  backgrounds.  ATACT 
members  have  effectively  drawn  from  their  individual 
experiences,  meshed  their  opinions,  and  spoken  effec¬ 
tively  to  ensure  the  development  of  an  operationally 
usable  AERA  2. 

PROCEDURE 

The  following  section  will  discuss  the  procedures  used 
to  develop  the  materials  presented  to  A'l  ACT.  First,  the 
researchers  identified  important  tasks  using  frequency 
and  criticality  estimates  derived  by  Ammerman,  Bergen, 
Davies,  Hostetler,  Inman,  and  Jones  (1987).  Next,  the 
researchers  developed  flow  charts  containing  the  tasks  to 
aid  ATACT  in  their  review.  ATACT,  as  a  group,  recom- 
mei.ded  modifications  to  the  flow  charts,  which  were 
incorporated  by  the  researchers.  The  researchers  then 
developed  a  candidate  set  of  9  abilities  and  a  group  of 
questions  to  guide  discussion  regarding  how  those  abili¬ 
ties  might  be  required  to  perform  the  tasks  identified 
above.  ATACT  members  individually  evaluated  the 
tasks  on  each  of  the  9  abilities,  then  discussed  their 
evaluations  as  a  group.  The  process  for  conducting  the 
study  is  discussed  in  more  detail  below. 

Derivation  of  AERA  2  Controller  Tasks 

This  section  describes  how  a  set  of  tasks  was  derived 
for  use  by  the  controller  team  in  making  judgments 
about  ability  requirements  for  AERA  2  controllers. 

Identification  of  tasks.  To  identify  the  tasks  to  be 
used  in  the  study,  the  researchers  first  obtained  both 
tasks  and  associated  frequency  and  criticality  estimates 
from  the  CTA,  Inc.  Air  Route  Traffic  Control  Center 
(ARTCC)  task  analysis  (Ammerman,  et  al.,  1 987).  These 
tasks  will  hereafter  be  referred  to  as  “en  route  HOST 
tasks”  because  they  describe  the  en  route  controller’s 
duties  when  operating  the  current  en  route  HOST 
computer.  A  set  of  24  en  route  HOST  tasks  was  identi¬ 
fied  that  had  high  ratings  on  both  the  frequency  of 


occurrence  and  criticality  dimensions,  according  to 
Ammerman,  et  al.  (1987).  The  researchers  then  derived 
a  set  of  2 1  AERA  2  tasks  from  the  descriptions  provided 
by  Ceiio,  McCabe,  &  Schultheis  (1990)  and  Fordham 
(1990). 

Appendix  A  shows  the  en  route  HOST  tasks  and  the 
AERA  2  tasks  considered  by  the  researchers  to  be  func¬ 
tionally  related.  The  en  route  HOST  tasks  for  which  no 
corresponding  AERA  2  tasks  were  available  were  elimi¬ 
nated  from  consideration  as  part  of  this  study  (e.g., 
“Housekeeping,  “Issuing  and  responding  to  pointouts”). 
ATACT  had  considered  some  issues  related  to  Data 
Link,  a  future  automation  capability  that  will  electroni¬ 
cally  transfer  information  between  ATC  automation  and 
aircraft  automation.  However,  a  different  controller 
team  is  responsible  for  defining  Data  Link  requirements. 
Thus,  this  study  did  not  address  tasks  involving  Data 
Link,  and  those  AERA  2  tasks  addressing  Data  Link 
(e.g.,  “Communicate  clearance  to  pilot  via  Data  Link”) 
were  also  eliminated  from  further  consideration.  Many 
of  the  remaining  AERA  2  tasks  appeared  to  be  very 
similar.  For  example,  the  AERA  2  tasks  “Perform  Air¬ 
craft  Conflict  Resolution,”  “Perform  Minimum  Safe 
Alrirude  Processing,”  and  “Perform  Airspace  Conflict 
Processing”  appeared  to  include  many  of  the  same 
subtasks,  and  thus  were  considered  equivalent. 

The  set  of  tasks  chosen  for  the  study  addressed  a 
variety  ofactivities  performed  by  controllers.  These  tasks 
included  a)  responding  to  pilot  requests  for  a  clearance 
change,  b)  responding  to  lateral  or  altitude  conformance 
deviations,  c)  performing  strategic  aircraft  conflict  reso¬ 
lutions,  and  d)  performing  tactical  aircraft  conflict  reso¬ 
lutions. 

Elements  or  steps  for  each  of  the  tasks  listed  above 
were  developed  using  the  Controller  Activity  Sequences 
(Ceiio,  McCabe,  and  Schultheis,  1 990)  and  the  AERA  2 
Operational  Description  (Fordham,  1990),  and  were 
displayed  as  flowcharts.  The  flowcharts  were  developed 
to  initiate  and  promote  discussion  among  ATACT  about 
the  specific  duties  associated  with  each  task  as  they 
expected  it  would  be  performed  by  the  AERA  2  control¬ 
ler. 

Controller  team  review.  The  four  preliminary  task 
flowcharts  described  above  were  presented  to  ATACT  at 
the  beginning  of  a  4-hour  review  and  discussion  period. 
Comments  made  by  ATACT  members  were  recorded. 


In  response  to  the  team’s  comments,  new  flow  charts 
representing  the  relationships  between  elements  of  the 
tasks  were  prepared  bv  researchers.  The  second  set  of 
flowcharts  was  then  presented  to  the  team  at  a  second 
meeting  held  3  months  later.  During  a  2-hour  session, 
the  team  reviewed  and  critiqued  each  task.  The  resulting 
comments  were  incorporated  into  a  third  set  of  flow¬ 
charts,  shown  in  Appendix  B.  “Issue  clearance  to  pilot," 
was  identified  as  a  subtask  or  “macro,”  and  was  split  out 
from  the  other  tasks  because  it  occurred  a  number  of 
times  as  a  part  of  other  tasks. 

Several  steps  involving  the  evaluation  and  decision¬ 
making  functions  of  the  controller  were  made  clear 
during  the  course  of  the  controller  review  of  the  prelimi¬ 
nary  flowcharts.  For  example,  in  Task  1  (“Respond  to 
pilot  request  for  clearance  change”),  the  steps  proposed 
by  the  researchers  as  part  of  the  original  flow  chart 
suggested  that  all  pilot  requests  would  be  fed  directly  to 
the  automation  for  evaluation  without  “preprocessing” 
by  the  controller.  AT ACT  members  pointed  out  that  in 
the  AERA  2  time  frame,  the  controller  would  continue 
to  make  judgments  about  the  validity  of  a  pilot’s  request 
(in  some  sense,  a  “sanity  check”)  to  screen  out  improper 
requests  and  would  submit  only  reasonable  requests  to 
the  automation.  The  controllers  also  suggested  that  they 
might  approve  some  requests  immediately,  without  con¬ 
sulting  the  automation.  The  resulting  Task  1  flowchart 
shows  that  the  controller  can  determine  the  validity  of  a 
request  and  approve  or  deny  it  without  first  consulting 
the  automation. 

AT ACT  also  pointed  out  that  AERA  2  controllers  will 
also  use  judgment  in  evaluating  problem  resolutions 
generated  by  the  automation.  A  controller  may  not 
accept  a  highest  ranked  resolution  (HRR)  generated  by 
the  automation  if  he  or  she  has  information  not  yet 
available  to  the  automation  (e.g.,  weather  hazards).  A 
controller  might  also  determine  that  if  a  requested  rout¬ 
ing  is  not  acceptable  because  it  would  result  in  a  conflict, 
it  would  be  better  to  forward  the  resolution  to  Auto 
Replan  (AR;  a  function  that  notifies  the  controller  when 
a  route  previously  requested  eventually  becomes  avail¬ 
able)  rather  than  trying  to  identify  alternative  clearances 
that  might  achieve  the  same  objective.  The  philosophy 
here  was  to  let  the  system  do  the  work,  especially  if  the 
controller  is  busy. 

Another  point  brought  out  during  the  discussions  was 
that  the  controller  will  need  to  ensure  the  flight  plan  data 


base  is  updated  to  reflect  changes  in  the  system  because 
the  accuracy  of  the  computations  performed  by  the 
Automated  Problem  Detection  (APD)  software  will 
depend  on  the  currency  of  aircraft  trajectories.  For 
example,  a  pilot  may  request  a  flight  plan  change  to  avoid 
hazardous  weather.  When  granting  the  request,  the 
controller  must  also  ensure  that  the  current  flight  plan  of 
the  aircraft  as  present  in  the  data  base  reflects  this  change. 
In  most  cases,  this  updating  will  be  facilitated  by  features 
of  the  automation. 

The  situation  in  which  a  tactical  maneuver  is  required 
to  resolve  a  conflict  is  the  AERA  2  task  most  similar  to 
today’s  operations.  Generally,  the  controller  is  expected 
to  monitor  the  display  for  potential  conflicts  and  not  just 
rely  on  the  automation  to  identify  them.  Ifa  conflict  alert 
occurs,  conflict  resolution  advisories  (CRAs)  will  be 
generated  to  assist  a  controller  in  maneuvering  aircraft 
clear  of  each  other.  Implementation  ofaCRA  will  ensure 
a  certain  period  of  conflict-free  flying,  but  will  not 
necessarily  include  a  clearance  that  allows  the  aircraft  to 
continue  to  its  destination.  Once  the  potential  conflict 
has  been  avoided,  the  controller  will  need  to  issue  a 
clearance  to  enable  the  aircraft  to  continue  on  its  desired 
route  of  flight.  The  controller  will  use  his  or  her  own 
judgment  and  the  assistance  of  AERA  tools  to  identify  a 
flight  path  that  will  take  the  aircraft  back  on  the  desired 
route  while  establishing  appropriate  separation.  Again, 
the  controller  will  be  required  to  ensure  that  the  AERA 
flight  plan  data  base  reflects  changes  made  to  the  aircraft’s 
flight  plan. 

Initial  Determination  of  AERA  2  Controller 
Abilities 

Ability  categories.  Nine  ability  categories  were  iden¬ 
tified,  based  on  a  review  of  the  CT A  Inc.  HOST/ 
ARTCC,  task  analysis  (Ammerman  et  al.,  1987).  The 
categories  identified  were  Spatial  Reasoning,  Verba! 
Reasoning,  Number  Reasoning,  Manual  Dexterity,  Se¬ 
lective  Attention,  Coding,  Short-term  Memory,  Time 
Sharing,  and  Long-term  Memory.  The  categorization  of 
Spatial,  Verbal,  and  Number  Reasoning  represents  a 
partitioning  of  the  complex,  higher-order  factors  of 
genera!  intelligence  (Ackerman,  1988;  Marshalek, 
I.ohman,  and  Snow,  198.3).  Manual  Dexterity,  in  con¬ 
trast,  reflects  the  less  complex,  more  speeded  response 
output  component  ofthis  hierarchical  model  ofabilities. 
The  Coding  and  Selective  Attention  abilities  were  drawn 
from  the  cognitive-sensory  attributes  developed  by 
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Ammerman,  bairhurst,  Hosteller,  &  [ones  (ll)8Q  in 
their  analyses  of  the  A  I  CS  occupation.  1  hese  abilities 
represent  the  perceptual  speed  factor  or  component  in 
Ackerman’s  conceptualization  of  general  intelligence. 
Short-  and  Long-term  Memory,  on  the  other  hand,  have 
been  described  as  structural  components  of  human  abili¬ 
ties  by  researchers  such  as  Shingledecker  <  ?  ‘>84 )  and 
Wickens  ( 1  984);  Am  merman  et  al.  ( 1 98-1)  also  incorpo¬ 
rated  Short  and  Long-term  Memory  into  their  tax- 
onomv  of  cognitive-sensors-  attributes.  1  ime  Sharing  is 
a  specific  construct  of  interest  in  A  LCS  selection  re¬ 
search  (Federal  Aviation  Administration,  1990;  Stoloff, 

1 088),  (The  ability  descriptions  and  related  examples  arc- 
shown  in  Appendix  C.) 

ATACT  provided  additional  examples  specific  to  air 
traffic  control  that  could  be  added  to  descriptions  of  the 
abilities.  Team  members  also  discussed  abilities  that  had 
not  been  included  on  the  list.  During  the  discussion,  the 
team  identified  decision-making,  problem  identifica¬ 
tion.  abstract  reasoning,  integration  of  information,  and 
certain  personality  characteristics  (e.g.,  “calmness  under 
fire  )  as  factors  or  abilities  also  needed  for  performance 
as  an  air  traffic  controller.  It  was  suggested  that  some  of 
these  abilities  might  be  encompassed,  in  part,  by  some  of 
the  abilities  already  listed,  and  that  personality  character¬ 
istics  were  deliberately  not  considered  as  part  of  this 
study. 

Discussion  questions.  The  researchers  identified  sev¬ 
eral  areas  of  discussion  to  assist  in  ascertaining  how  the 
9  abilities  might  be  associated  with  performing  the  4 
ALRA  2  tasks.  The  following  questions  were  considered: 
“How  important  is  this  ability  to  acceptable  perfor¬ 
mance  of  the  task?,"  "How  important  is  speed  in  using 
this  ability  to  perform  the  task?,  “is  this  ability  required 
to  perform  the  task  on  the  first  day  of  On-the-job 
braining  (OJT)?,”  "How  important  is  training  in  using 
this  ability  to  perform  the  task?."  and  “How  will  the 
requirement  for  this  ability  in  ALRA  2  change  from  the 
current  system?.” 

These  questions  were  discussed  to  obtain  an  indica¬ 
tion  of  the  importance  of  each  ability  and  how  it  could 
feasibly  be  used  or  developed.  In  some  cases,  it  might  be 
necessary  for  a  student  (developmental)  controller  to 
have  an  ability  before  beginning  OJT;  in  other  cases, 
some  level  of  an  ability  could  be  acceptable,  if  it  were 
further  developed  during  OJT.  Another  factor  of  interest 
was  whether  it  was  acceptable  simply  to  have  the  ability. 


or  if  speed  o(  its  use  was  also  an  important  determinant 
of  success.  Moreover,  ability  domains  identified  as  im¬ 
portant  and  needed  on  the  first  day  of  OJ1  would  be 
logical  candidates  for  inclusion  in  future  selection  batter¬ 
ies.  Those  not  needed  the  first  day  of  OJT  might  be 
considered  skills,  which  could  be  further  developed  later 
during  OJ’I  • 

1  he  final  question  addressed  the  requirement  for  each 
ability  in  the  ALRA  2  time  frame,  as  compared  with  the 
requirement  for  it  in  the  current  s»  stem.  1  he  rescaichcrs 
expected  that  understanding  the  controllers'  assessments 
of  the  relationship  between  current  and  future  require¬ 
ments  would  be  made  clearer  through  oral  discussions. 

Process 

1  he  abilities  and  discussion  questions  were  explained 
to  ATACT  using  the  handout  shown  in  Appendix  C. 
beam  members  were  asked  to  evaluate  each  question 
independently  for  each  task  as  a  way  of  initiating  discus¬ 
sion.  First,  team  members  independently  evaluated  all 
questions  related  to  1  task  before  proceeding  to  the  next. 
The  flow  charts  from  Appendix  B  were  provided  for  the 
controllers  to  use  as  reference  materials.  Members  were 
asked  to  consider  each  task  as  a  whole.  If  an  ability  was 
required  to  perform  a  part  of  the  task,  then  it  was  to  be 
considered  required  to  perform  the  whole  task.  Second, 
the  evaluations  were  discussed  by  the  group  to  discover 
the  reasoning  behind  thcii  individual  evaluations.  Counts 
of  individual  evaluations  were  made  and  comments 
provided  by  the  controllers  during  the  group  discussion 
were  recorded. 

Before  beginning,  the  team  independently  evaluated 
and  discussed  questions  about  how  the  Spatial  Reason¬ 
ing  and  Verbal  Reasoning  abilities  related  to  the  sample 
macro  task,  “Is'ue  Clearance  to  Pilot,  to  become  famil¬ 
iar  with  how  the  process  was  intended  to  work. 

Ri-SiTi.is 

Question  1:  Importance.  Two-thirds  or  more  of  the 
team  indicated  that  each  ability  was  important  tor  each 
of  the  4  tasks,  with  the  exception  of  Number  Reasoning. 
Only  4  of  the  9  controllers  thought  that  Number  Rea 
soiling  would  be  important  when  processing  conform 
ancc  deviations  and  resolving  conflicts  in  srrategir 
situations.  Team  members  who  thought  Number  Rea¬ 
soning  would  not  be  very  important  for  those  tasks 


indicated  that  the  automation  would  perform  many  of 
the  numerical  calculations.  Moo  over,  much  of  the  pre¬ 
sentation  of  information  i:  the  AIR  A  2  time  frame 
would  be  in  a  graphical  form,  requiring  less  explicit 
numerical  computation  by  the  controller. 

It  isr'so  interesting  to  note  that  all  controllers  thought 
Ci  o’  ,g  would  be  vers'  important  in  performing  the 
Af’.RA  2  tasks  included  in  the  study.  I  earn  members 
indicated  that  the  tvpe  of  data  the  Ah.RA  2  controller 
would  be  required  to  process  would  be  much  different 
than  the  tvpe  of  data  processed  today.  The  requirement 
to  convert  or  decode  certain  information  (e.g.,  flight 
progress  data)  will  be  reduced  somewhat  in  Ah.RA  2 
because  the  automation  tools  will  provide  that  service. 
However,  the  svstem  will  provide  a  considerable  amount 
of  other  tvpes  of  information  (e.g.,  trial  plans,  shorthand 
representations  for  clearances)  that  the  Ah.RA  2  control¬ 
ler  will  have  to  interpret. 

h.very  member  of  the  team  thought  that  Spatial  Rea¬ 
soning  would  be  important  in  performingall  tasks  except 
“Process  conformance  deviations."  All  but  1  thought 
Spatial  Reasoning  would  be  important  for  that  task.  It 
was  thought  that  Spatial  Reasoning  would  be  important 
in  interpreting  the  graphic  information  provided  bv  the 
automation  and  in  becoming  oriented  to  the  problems 
identified  bv  the  automation. 

Question  2:  Speed.  Two-thirds  or  more  of  the  con¬ 
trollers  thought  that  speed  in  using  most  of  the  abilities 
would  be  important  in  performing  most  of  the  tasks, 
hour  of  the  9  controllers  thought  that  speed  in  using 
Number  Reasoning  would  be  of  little  importance  in 
processing  conformance  deviations  and  resolving  con¬ 
flicts  in  strategic  situations.  This  result  would  be  ex¬ 
pected,  given  that  the  same  controllers  did  not  think  that 
Number  Reasoning  was  very  important  for  performing 
those  tasks.  Also,  only  4  of  the  9  participants  thought 
that  speed  would  be  important  when  using  Verbal  Rea¬ 
soning  to  resolve  conflicts  in  strategic  situations.  Their 
reasoning  was  that  in  the  Ah.RA  2  time  frame,  there 
should  be  much  less  verbal  communication  required 
with  a  pilot  overall,  although  when  communication  was 
required,  it  would  be  very  important. 

Qnlv  S  of  the  9  controllers  thought  that  speed  in  using 
Selective  Attention  would  be  important  in  addressing 
pilot  requests  for  clearance  changes,  and  that  speed  in 
using  Short-  t  erm  Memory  would  be  important  in  pro¬ 


cessing  conformance  deviations.  I  hose  who  thought 
that  speed  was  not  important  in  using  Selective  Atten¬ 
tion  to  process  pilot  requests  for  clearance  changes 
indicated  that  there  would  be  fewer  distractions  in  the 
AKRA  2  time  frame  because,  among  other  reasons,  there 
should  be  fewer  pilots  on  the  radio  due  to  increased  use 
of  Data  l  ink.  Those  who  thought  that  speed  in  using 
Short-  Term  Memory  would  nor  be  important  in  pro¬ 
cessing  conformance  deviations  indicated  that  speed  will 
be  required  in  solving  problems,  but  the  reconformance 
issue  will  not  usuallv  involve  a  problem.  Most  of  the  time 
the  automation  will  already  reconform  the  trajectory  to 
match  the  path  of  flight,  and  most  of  the  communication 
with  the  pilot  would  be  to  ensure  that  the  pilot’s  inten 
tions  match  the  flight  plan  data  base.  In  general,  how¬ 
ever,  it  was  considered  that  most  of  the  information  tube 
remembered  would  be  available  through  the  automation 
and  thus,  speed  in  using  Short- 1  erm  Memors  would  be 
of  reiativelv  little  importance  to  job  performance. 

All  of  the  team  thought  that  speed  in  Coding  would 
be  important  when  performing  all  tasks  except  resolving 
conflicts  in  strategic  situations.  On  that  task,  all  but  one 
thought  that  speed  of  Coding  would  be  important 
because  Coding  occurs  before  most  of  the  other  abilities 
are  used. 

Question  3:  Needed  first  day  of  O  i  l .  Two-thirds  or 
more  of  the  controllers  thought  that  most  ol  the  abilities 
would  be  required  to  perform  most  of  the  tasks  on  the 
first  day  of  OJT.  The  most  notable  exceptions  were  that 
the  team  split  (4  vs.  S  or  S  vs.  4)  on  w  hether  they  thought 
Selective  Attention  would  be  necessary  on  the  first  day  of 
Off  when  dealing  with  pilot  requests  for  clearance 
change,  processing  conformance  deviations,  and  resolv¬ 
ing  conflicts  in  a  strategic  mode.  Those  who  thought  that 
Selective  Attention  was  not  important  on  the  first  day  of 
Q|  T  considered  it  to  be  more  ofa  skill  than  an  ability  — 
in  the  sense  that  it  could  be  developed,  or  improved  upon 
overtime.  They  also  indicated  that  in  some  tasks,  notable 
processing  conformance  deviations,  there  will  be  more 
time  to  analyze  the  situation  and  fewer  activities  compet¬ 
ing  forattention.  Therefore,  the  developmental  control¬ 
ler  could  probably  be  taught  how  to  perform  the  task  as 
an  isolated  activity,  not  requiring  as  much  Selective 
Attention  as  other  tasks. 

Qnlv  4  of  the  9  team  members  thought  that  I  ime 
Sharing  would  be  required  on  the  first  day  of  (  ^1  I  when 
resolving  conflicts  in  a  strategic  mode.  I  hose  wh"  dw 
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agreed  thought  that  if  the  developmental  had  the  con¬ 
cepts  of  time  sharing,  given  that  the  steps  involved  in 
conflict  resolution  would  be  performed  in  a  different 
sequence  than  presently,  then  utilizing  I  ime  Sharing 
could  be  developed  over  time  and  would  not  be  necessary 
when  beginning  OJ'I  . 

Onlv  3  of  the  9  team  members  thought  that  Number 
Reasoning  would  be  required  for  the  first  day  of  OJ’I 
when  processing  conformance  deviations.  I  hose  who 
thought  Number  Reasoning  would  be  important  on  the 
first  das-  of  OJT  thought  that  both  Spatial  and  Number 
Reasoning  would  be  used  to  observe  aircraft  drift.  1  hose 
that  thought  it  would  not  be  important  on  the  first  day 
of  O )  I  thought  that  it  was  less  important  than  the  other 
abilities  in  the  performance  of  this  task  because  most  of 
the  time  the  automation  would  have  already  reconformed 
the  aircraft  s  flight  trajectory;  the  controller  would  have 
to  perform  this  task  onlv  under  unusual  circumstances. 

All  of  the  team  members  thought  that  Spatial  Reason¬ 
ing  would  be  required  on  she  first  day  of  OJ’I  when 
performing  all  tasks,  except  processing  conformance 
deviations,  for  that  task,  all  but  one  thought  Spatial 
Reasoning  would  he  required  on  the  first  day  of  OJ  I  .  It 
was  thought  that  Spatial  Reasoning  would  be  important 
in  interpreting  the  graphic  information  provided  by  the 
automation  and  in  evaluating  alternative  resolutions.  A 
certain  amount  of  Spatial  Reasoning  should  be  required 
when  the  developmental  starts  training,  but  most  of  the 
i  ont  rollers  also  thought  that  the  use  of  Spatial  Reasoning 
could  be  enhanced  through  training. 

All  of  the  team  thought  that  Short  Term  Memory' 
would  be  required  on  the  first  day  of  OJ’I  to  perform  ail 
tasks,  but  Process  Conformance  Deviations;  for  that 
task,  all  but  2  thought  that  Short  I  erm  Memory  would 
be  required  on  the  first  day  of  OJ  I  ,  It  was  thought  that 
it  w  as  difficult  to  teach  Short  1  erm  Memory  skills  so.  for 
the  most  part,  thev  would  need  to  be  present  on  the  first 
day  of  OIT. 

Question  3;  Enhancement  bv  training.  I  wo  thirds  or 
more  of  the  team  indicated  that  training  would  enhance 
the  use  of  abilities  for  every  task.  It  is  interesting  to  note 
that  all  ream  members  thought  that  Spatial  Reasoning 
and  Coding  could  be  enhanced  through  training  for  all 
the  tasks.  It  is  also  interesting  to  note  that  all  but  I 
controller  thought  that  all  abilities  could  be  enhanced 


through  training  when  resolving  conflicts  in  a  tactical 
situation. 

Question  5:  Change  in  requirement  for  abilities. 
There  was  considerable  variation  in  the  assessments  of 
changes  in  ability  requirements;  for  a  number  of  tasks, 
several  controllers  thought  the  requirement  for  an  ability 
would  be  higher,  while  for  the  same  tasks,  other  control¬ 
lers  thought  the  requirement  would  be  lower.  However, 
there  were  some  trends  in  the  data. 

The  team  members  thought  that  there  would  be 
almost  no  change  in  the  abilities  required  to  resolve 
conflicts  in  a  tactical  situation.  Although  the  CRA  auto¬ 
mation  will  provide  a  proposed  resolution  to  the  control¬ 
ler.  the  team  thought  that  the  requirement  to  rapidly 
evaluate  an  automation-generated  resolution  should  not 
be  much  different  than  today’s  requirement  to  quickly 
evaluate  controller-generated  resolutions. 

T  he  team  thought  that  the  requirement  for  Verbal 
Reasoningand  Short  Term  Memory  in  the  4  tasks  would 
be  virtually  the  same  in  the  Ah.RA  2  time  frame  as  it  was 
at  the  time  of  the  study.  The  team  indicated  that  any  time 
there  was  a  requirement  to  talk  with  a  pilot.  Verbal 
Reasoning  would  be  important.  Just  as  Verbal  Reason¬ 
ing  is  important  in  today's  ATC  system,  it  will  continue 
to  be  important  in  the  future,  although  the  frequency  of 
it’s  use  may  be  lower,  due  to  increased  reliance  upon 
Data  I  ink.  Short  Term  Memory  requirements  may- 
change  with  respect  to  the  specific  information  to  be 
remembered,  but  there  w  ill  always  be  some  information 
that  the  controller  will  have  to  remember  for  short 
periods  of  ,ime. 

l  ive  of  the  l)  team  members  thought  that  the  require¬ 
ment  tor  Number  Reasoning  would  be  reduced  when 
processing  pilot  requests  for  clearance  change  in  the 
A  IRA  2  time  frame.  The  team  members  indicated  that 
many  of  the  calculations  currently  required  to  perform 
that  task  would  be  performed  by  the  automation.  While 
an  Ah.RA  2  controller  will  still  need  to  use  Number 
Reasoning  to  perform  the  task,  the  automation  will 
provide  considerable  assistance. 

Six  of  the  9  members  of  A  I  A(  T  thought  that  there 
would  be  a  higher  requirement  lor  Manual  Dexterity 
when  processing  pilot  requests  for  clearance  change,  and 
when  resolving  conflicts  in  a  strategic  situation.  Some  of 


the  team  members  indicated  that  AERA  2  automation 
was  being  designed  to  minimize  “button  pushing"  and 
that  there  would  be  less  to  be  typed.  Others  indicated 
that  in  today’s  system  not  much  data  entry  is  required. 
They  thought  that  a  certain  amount  of  data  entry  will  be 
required  when  constructing  the  problem  for  the  automa¬ 
tion  to  examine.  It  seemed  that,  while  it  might  be 
necessary  to  “pound”  fewer  keys,  Manual  Dexterity 
would  still  be  important  in  locating  the  appropriate 
function  keys  quickly.  In  general,  the  feeling  was  that 
“the  faster  you  are  with  the  keyboard,  the  better  off  you 
will  be.” 

There  was  also  some  difference  of  opinion  about  the 
change  in  the  need  for  Manual  Dexterity  when  process¬ 
ing  conformance  deviations,  and  in  using  Selective  At¬ 
tention,  when  processing  pilot  requests  for  clearance 
change.  Some  team  members  thought  that  keyboard 
entry  would  occur  less  frequently  when  processing  con- 
frrmance  deviations,  unless  a  pilot’s  clearance  needs  to 
be  changed.  Other  team  members  thought  that  when 
there  is  a  requirement  to  change  a  clearance,  it  would 
have  to  be  done  quickly,  thus  increasing  the  requirement 
for  Manual  Dexterity. 

Regarding  the  requirement  for  Selective  At^ntion, 
some  controllers  thought  that  there  wouid  be  fewer 
events  occurring  simultaneously  in  the  AERA  2  time 
frame  (most  notably  fewer  pilots  using  radio  frequencies) 
and  thus  the  requirement  for  Selective  Attention  would 
be  less.  Others  thought  that  there  would  be  other  things 
going  on  in  the  sector  and  that  Selective  Attention  would 
still  be  required  when  processing  clearance  change  re¬ 
quests. 

Five  of  the  9  team  members  thought  that  implemen¬ 
tation  of  AERA  2  would  increase  the  requirement  for 
Coding  when  processing  pilot  requests  for  clearance 
change,  and  7  of  the  9  thought  that  it  would  increase  the 
requirement  for  Coding  when  resolving  conflicts  in  a 
strategic  situation.  Team  members  indicated  that  Cod¬ 
ing  is  not  required  extensively  when  evaluating  separa¬ 
tion  in  today’s  system,  but  will  be  in  AERA  2. 

Finally,  there  was  some  disagreement  about  the  role  of 
a  number  of  abilities  in  processing  pilot  requests  for 
clearance  change  and  resolving  conflicts  in  a  strategic 
mode.  Four  team  members  thought  the  requirement  for 
Spatial  Reasoning  would  be  more  important  for  process¬ 
ing  pilot  requests  for  clearance  change  in  the  AERA  2 


time  frame  than  at  present,  while  2  thought  it  would  be 
less  than  at  present.  AI  o,  3  team  members  thought  the 
requirement  for  Spatial  Reasoning  would  be  more  im¬ 
portant  for  resolving  conflicts  in  a  strategic  role  in  the 
AERA  2  time  frame  than  at  present,  while  2  thought  it 
would  be  less  than  at  present.  Those  who  thought  Spatial 
Reasoning  would  be  less  important  said  that,  since  the 
flight  progress  data  would  be  in  a  graphic  mode,  it  would 
be  easier  to  understand,  and  thus  would  require  less 
Spatial  Reasoning.  Those  who  thought  Spatial  Reason¬ 
ing  would  be  more  important  said  that,  due  to  increasing 
traffic  volume,  the  AERA  2  controller  would  likely  be 
required  to  solve  more  problems  than  at  present  and 
would  not  always  take  the  time  to  use  the  graphical 
displays.  Also,  they  thought  that  increased  Spatial  Rea¬ 
soning  ability  would  be  required  for  orientation  to  the 
problem  presented  by  the  automation. 

Two  controllers  thought  the  requirement  for  Long- 
Term  Memory  would  be  more  important  for  processing 
pilot  requests  for  clearance  change  in  the  AERA  2  time 
frame  than  at  present,  while  2  thought  it  would  be  less 
than  at  present.  Also,  4  controllers  thought  the  require¬ 
ment  for  Long-Term  Memory  would  be  more  important 
for  resolving  conflicts  in  a  strategic  role  in  the  AERA  2 
time  frame  than  at  present,  while  2  thought  it  would  be 
less  than  at  present.  Those  who  thought  that  Long-Term 
Memory  would  be  more  important  indicated  that,  based 
on  current  ACCC  and  AERA  2  specifications,  there  will 
be  130  controller  commands  and  that  Long-Term 
Memory  will  play  a  big  role  if  all  the  steps  are  performed 
when  evaluatinga  possible  resolution.  Those  who  thought 
Long-Term  Memory  would  be  less  important  said  that 
there  are  a  lot  of  things  to  remember,  but  that  the 
automation  will  do  most  of  the  remembering  for  the 
controller.  For  example,  controllers  will  no  longer  have 
to  remember  the  appropriate  radio  frequencies  for  pilots 
to  tunc  in  when  crossing  sector  boundaries. 

Conclusions 

Preliminary  findings.  In  spite  of  a  number  of  factors 
that  might  limit  the  interpretabi I ity  of  these  results 
(discussed  below),  the  oral  discussions  of  AT  ACT  indi¬ 
cated  that  a  number  of  changes  in  controller  tasks  would 
occur  in  the  AFLRA  2  time  frame.  The  team  thought  that 
the  AERA  2  controller’s  reliance  on  textual  presentation 
of  flight  progress  data  should  be  reduced  because  data 
would  be  more  often  displayed  in  graphic  form.  The 
requirement  to  sort  rapidly  through  the  current  graphic 
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and  textual  information  to  identify  problems  will  be 
reduced  significantly,  with  the  automation  identifying 
most  problems.  AERA  2  will  greatly  reduce  the  need  for 
verbal  coordination  wbh  other  sectors.  Many  of  the 
details  that  a  controller  must  remember  at  present  will  be 
supplanted  by  automation  aids,  although  it  appears  that 
other  types  of  detail  may  be  important  in  the  AERA  2 
time  frame.  For  example,  the  AERA  2  controller  will 
have  to  remember  the  command  structure  and  capabili¬ 
ties  of  the  automation. 

On  the  other  hand,  the  automation  will  enhance  the 
controller's  view  of  the  system  so  that  he  or  she  can 
develop  a  broader  perspective  of  system  events  than  is 
currently  feasible.  In  today’s  system,  the  controller  can 
foresee  some  events  well  in  advance,  but  has  limited 
information  available  about  events  occurring  outside 
his/her  own  sector.  Without  coordination  with  others, 
today’s  controllers  have  limited  knowledge  of  events 
occurring  outside  their  sector,  although  they  can  take 
actions  that  will  affect  other  controllers.  In  the  AERA  2 
time  frame,  the  aircraft  that  the  controller  will  be  able  to 
examine  and  influence  will  expand  across  both  sectors 
and  time.  As  a  result,  the  AERA  2  controller  will  increas¬ 
ingly  issue  clearances  to  prevent  the  development  of 
problems  predicted  to  occur  in  another  controller’s 
sector. 

Some  acfivities  are  likely  to  remain  the  same.  There 
will  still  be  a  need  to  communicate  with  pilots.  There  will 
be  times  when  a  controller  will  have  to  take  steps  to 
separate  aircraft,  without  the  heip  of  an  automated 
problem  detection  or  resolution  tool.  The  AERA  2 
controller  will  still  need  to  analyze  all  situations  to  make 
decisions  and  solve  problems,  both  short-  and  long¬ 
term. 

There  will  be  some  tradeoffs  in  activity.  Although  the 
goals  of  those  designing  the  system  are  to  support  an 
effective  interface  between  controller  and  the  system, 
team  members  indicated  that  to  fully  utilize  the  system, 
keyboard  manipulation  will  still  be  required.  While 
translation  and  interpretation  of  some  data  will  be  re¬ 
duced,  the  types  of  data  to  be  processed  should  be 
different  in  the  AERA  2  time  frame,  so  data  translation 
and  interpretation  in  some  form  (e.g.,  Coding)  will  still 
be  important.  More  translation  and  data  interpretation 
will  be  necessary  if  less  keyboard  activity  occurs. 


Some  team  members  observed  that  the  AERA  2 
system  was  oriented  toward  today’s  controller  and  that  it 
was  probably  designed  to  perpetuate  the  way  air  traffic 
controllers  manage  traffic  in  the  current  nonautomated 
environment.  Others  thought  that  there  might  be  a 
tendency  to  sit  back  and  let  the  system  run  without  much 
involvement.  They  said  that  it  would  take  work  for  an 
AERA  2  controller  to  become  involved  and  maintain 
effective  interaction  with  the  system. 

What  do  these  discussions  mean  when  trying  to 
identify  the  abilities  required  to  perform  the  job  of 
AERA  2  controller?  ATACT  members’  evaluations  of 
questions  regarding  change  in  ability  requirements  and 
their  oral  evaluations  indicated  that  AERA  2  controllers 
should  have  about  the  same  high  levels  of  most  of  the 
nine  broad  abilities  discussed  in  order  to  perform  the 
tasks  examined  in  this  study.  ATACT  was  unable  to 
determine  analytically  that  the  requirement  for  any  of 
the  abilities  required  to  perform  the  job  of  air  traffic 
controller  in  the  en  route/HOST  environment  would  be 
notably  different  in  the  AERA  2  environment.  Also,  they 
found  nothing  to  suggest  that  any  additional  abilities  not 
currently  required  would  be  required  in  the  AERA  2  time 
frame.  Thus,  it  appears  that  selection  procedures  identi¬ 
fied  as  being  appropriate  for  today’s  controller  may  also 
be  appropriate  for  the  AERA  2  controller. 

Limitations.  A  number  of  factors  could  limit  the 
interpretability  of  this  study.  The  study  addressed  only  4 
of  the  tasks  to  be  performed  by  the  AERA  2  controller. 
Examination  of  other  tasks  could  result  in  identification 
of  different  relationships  between  abilities  and  task  per¬ 
formance.  Expansion  or  modification  of  the  abilities  list 
may  also  be  appropriate  to  identify  all  requisite  abilities 
for  the  AERA  2  controller. 

It  is  possible  that  the  SMEs  could  have  overestimated 
the  similarity  between  the  requirements  for  performing 
the  job  in  the  AERA  2  time  frame,  as  compared  with 
performing  the  job  in  its  current  form.  Previous  research 
suggests  that  people  tend  to  believe  that  events  they  can 
recall  or  imagine  generally  occur  more  frequently  than 
events  they  do  not  recall  or  cannot  easily  imagine  (Tverskv 
&  Kahneman,  1974).  Having  difficulty  in  imagining 
circumstances  requiring  the  use  of  different  abilities  to 
perform  the  jobofAERA  2  controller  could  affect  SMEs’ 
expectations  about  their  relevance  in  performing  the  job. 
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Such  biases  may  have  operated  in  other  SME  assessments 
of  future  jobs.  Schneider  and  Konz  (1989)  found  that 
“incumbents’  views  of  tasks  and  KSAs  for  today’s  jobs  are 
generally  highly  correlated  with  SMEs’  projections  of  the 
future,”  though  they  cautioned  that  “high  correlation 
does  not  equal  agreement.”  It  will  be  important  to 
identify  the  aspects  of  the  future  job  on  which  the  SMEs 
focus  when  making  their  ratings,  and  what  kinds  of 
processes  they  use  to  make  their  ratings. 

While  there  have  been  extensive  analyses  and  discus¬ 
sions  of  AERA  2  requirements,  it  is  very  early  in  the 
development  cycle.  AT ACT’s  opinions  in  this  report  are 
based  on  these  discussions  and  limited  prototype  labora¬ 
tory  experience,  rather  than  actual  job  performance. 
Further,  more  sophisticated,  laboratory  investigations 
could  affect  the  results  of  this  study. 

After  this  study  was  conducted,  the  researchers  met 
with  the  controller  team  to  review  an  early  draft  of  this 
document.  The  team  had  just  observed  a  prototype 
demonstration  of  AERA  2  data  displays.  While  the 
prototype  reflected  many  of  ATACT’s  operational  re¬ 
quirements,  most  members  thought  that  it  displayed 
more  data  than  were  needed  for  operational  use.  it  was 
pointed  out  that  reactions  to  such  demonstrations  would 
produce  a  re-examination  of  requirements,  which  could 
result  in  changes  to  requirements.  Therefore,  the  team 
felt  that  definitive  statements  about  the  duties  of  the 
AERA  2  controller  or  the  abilities  required  of  the  AERA 
2  controller  were  premature  at  the  time  of  this  study. 

ATACT’s  familiarity  with  the  system  will  increase  as 
additional  prototypes  are  developed  and  tested.  Plans  for 
how  the  AERA  2  controller  will  interact  with  the  auto¬ 
mation  may  also  change  before  the  system  is  imple¬ 
mented.  These  factors  make  it  necessary  to  re-examine 
this  topic  and  replicate  and  extend  this  study  over  time, 
before  the  system  goes  on  line,  using  a  larger  controller 
sample  that  has  some  prototype  and  operational  test  and 
evaluation  experience  with  AERA  2. 
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Atphndix  A 


Comparison  of  Controller  Tasks  in  En  Route  HOST  and  AERA  2  Environments 
Activity  1:  Perform  situation  monitoring 

1.  En  Route  HOST  tasks  2.  Related  AERA  2  tasks 

Checking  and  evaluating  separation  Observe  computer-generated  alert 

Conflict  alert 

Processing  departure/en  route  time  information  Generate  resolution  through  single 

aircraft  planning 

Housekeeping  Not  covered 
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Activity  2:  Resolve  aircraft  conflictions 


1 .  En  route  HOST  tasks 

Perform  aircraft  conflict  resolution 


Perform  minimum  safe  altitude  processing 


Perform  airspace  conflict  processing 


Issuing  unsafe  condition  advisories 


2.  Related  AERA  2  tasks 

Observe  computer-generated  alert 
Assess  operational  suitability  of  automation¬ 
generated  resolutions 
Obtain  additional  problem  information 
Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 
Conflict  alert 

Observe  computer-generated  alert 
Assess  operational  suitability  of  automation¬ 
generated  resolutions 
Obtain  additional  problem  information 
Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 
Conflict  alert 

Observe  computer-generated  alert 
Assess  operational  suitability  of  automation¬ 
generated  resolutions 
Obtain  additional  problem  information 
Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 
Conflict  alert 

Resolve  problem  unknown  to  automation 
Provide  VFR  traffic  advisories  for  aircraft  without 
altitude  encoding  transponders 


Activity  3:  Manage  air  traffic  sequences 

1.  En  route  HOST  tasks  2.  Related  AERA  2  tasks 

Respond  to  traffic  management  constraints/flow  Observe  computer-generated  alert 

conflicts  Assess  operational  suitability  of  automation¬ 

generated  resolutions 
Obtain  additional  problem  information 
Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 

Processing  deviations  Out  of  conformance  -  descent,  lateral  deviation 

Observe  computer-generated  alert 
Assess  operational  suitability  of  automation¬ 
generated  resolutions 

Establishing  arrival  sequences  Obtain  additional  problem  information 

Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 
Resolve  problem  unknown  to  automation 

Managing  departure  flows  Observe  computer-generated  alert 

Assess  operational  suitability  of  automation¬ 
generated  resolutions 
Obtain  additional  problem  information 
Review  and  evaluate  operational  feasibility  of  lower 
ranked  resolutions 

Generate  resolution  through  single  aircraft 
planning 

Implement  problem  resolution 
Resolve  problem  unknown  to  automation 
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Activity  4:  Route  or  plan  flights 


1.  En  route  HOST  tasks 


2.  Related  AERA  2  tasks 


Planning  clearances 

Responding  to  contingencies 

Reviewing  flight  plans 

Processing  flight  plan  amendments 

Receiving  transfer  of  control/radar  information 

Initiating  transfer  of  control/radar  information 

Issuing  pointouts 

Responding  to  pointouts 

Issuing  clearances 


Establishing,  maintaining,  and  terminating  radio 
communications 


Establishing/ re-establishing  radar  identification 


Generate  resolution  through  single 
aircraft  planning 

Not  covered 

Pilot  request  for  IFR  clearance 
Pilot  request  for  clearance  change 
Control  transfer  acceptance 
Control  transfer  initiation 
Not  covered 
Not  covered 

Communicate  clearance  to  pilot  via 
data  link 

Communicate  clearance  to  pilot  via 
radio 

Transfer  of  communications  - 
Initiating  sector 
Transfer  of  communications  - 
Receiving  sector 

Transfer  of  communications  - 
Receiving  sector 


1.  En  route  HOST  tasks 
Processing  weather  reports 


Activity  5:  Assess  weather  impact 

2.  Related  AERA  2  tasks 

Obtain  additional  probieminformation 


1 .  En  route  HOST  tasks 


Activity  6:  Manage  sector/position  resources 

2.  Related  AERA  2  tasks 


Assuming  position  responsibility 


Not  covered 
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Appendix  B 

AERA  2  Task  Flow  Charts 


Af"'*  Tath  1  Pesoond  to  pilot  request  *or  clearance  change 


B~1 


RERfi  Task  D:  Process  Conformance  Deviations 


B-2 
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Appendix  C 

MEETING  WITH  ATACT  MAY  20-21,  1991 
AERA  2  ABILITY  REQUIREMENTS 


Purpose 

The  purpose  of  this  meeting  is  to  identify  human 
abilities  that  are  likely  to  be  required  to  perform  a  set  of 
AERA  2  controller  tasks. 

Process 

First,  the  AERA  2  task  descriptions  will  be  reviewed. 
These  task  descriptions  are  based  on  input  from  ATACT 
in  February,  1991. 

Second,  descriptions  of  selected  human  abilities  will 
be  reviewed  with  the  team.  The  rating  scales  to  be  used 
to  assess  the  requirement  for  those  abilities  will  also  be 
discussed. 

Third,  team  members  will  evaluate  which  abilities 
might  be  required  to  perform  each  AERA  2  task  at  an 
acceptable  level  of  performance. 

Fourth,  ATACT  will  be  asked  to  develop  a  group 
consensus  on  the  abilities  that  might  be  required  to 
perform  each  AERA  2  task. 

HUMAN  ABILITIES 

Ability 

Ability,  in  personnel  psychology,  is  what  a  person 
brings  to  the  job  situation  without  benefit  of  specialized, 
job-specific  training,  education,  or  experience.  Ability, 
at  that  point,  has  already  been  shaped  by  general  educa¬ 
tion  and  experience.  However,  people  do  not  all  have  the 
same  levels  of  abilities  as  they  come  into  a  job  situation. 
Consider,  for  example,  the  ability  to  read.  The  ability  to 
read  is  the  product  of  education  and  practice  prior  to 
employment.  Yet  for  a  variety  of  reasons,  ranging  from 
native  intelligence  to  the  curriculum  used  to  teach  read- 
in",  the  ability  to  read  varies  from  person  to  person. 
5  .e  people  can  read  complex  materials  easily  and 
quickly,  while  others  struggle  with  a  newspaper.  The 


person  that  reads  well  will  have  less  difficulty  in  a  job  task 
requiring  reading  than  a  person  who’s  reading  skills  are 
not  as  strong,  while  their  job  performance  may  be  exactly 
the  same  on  another  task  in  which  reading  is  not  even 
required. 

There  are  many  kinds  of  abilities.  Our  focus  is  on 
relatively  broad  mental  abilities.  Mental  abilities  are  the 
fundamental,  basic,  and  to  some  degree  abstract,  capaci¬ 
ties  and  processes  of  thinking,  perceiving,  and  deciding. 
Mental  abilities  are  the  operations  of  the  mind,  not  to  be 
confused  with  the  content  (for  example,  aircraft  perfor¬ 
mance  characteristics)  or  the  product  (a  clearance),  or 
the  quality  of  the  performance. 

Knowledge  and  skill 

Knowledge  and  skill,  in  contrast,  are  the  products  of 
job-specific,  specialized  training,  education,  and  experi¬ 
ence.  Knowledge  is  the  job-specific  content  or  informa¬ 
tion  used  by  the  mental  abilities.  Skill  is  the  quality  of 
performance  based  on  the  combination  of  ability  and 
knowledge  after  practice  and  training  on  a  task.  Skills  are 
specific  to  job  tasks;  knowledges  are  specific  to  jobs;  but 
abilities  are  relatively  independent  of  specific  jobs.  Knowl¬ 
edge  and  skill  improve,  often  dramatically,  with  instruc¬ 
tion  and  practice.  Knowledge  and  skill  are  acquired 
rather  than  innate.  For  example,  a  developmental  con¬ 
troller  is  instructed  in  aircraft  performance  characteris¬ 
tics.  A  controller  learns  to  separate  aircraft  through 
instruction  and  practice.  In  a  sense,  knowledge  and  skill 
are  built  upon  the  foundation  of  mental  abilities  that  a 
person  brings  to  the  situation. 

Definitions  of  human  abilities 

We  have  identified  a  number  of  abilities  which  de¬ 
scribe  some  of  the  human  capacities  likely  to  be  involved 
in  air  traffic  control.  We  have  excluded  from  this  list 
some  abilities  that  we  assume  all  controllers  must  have, 
such  as  the  ability  to  see  or  hear. 
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Human  Mental  Abilities  and  ATC  Examples 


Ability 

Spatial  reasoning 

The  ability  to  recognize,  combine,  separate,  and  ma¬ 
nipulate  figures,  graphics,  or  other  spatial  data  in  order 
to  solve  a  problem 

Verbal  reasoning 

The  ability  to  recognize,  combine,  separate,  and  ma¬ 
nipulate  words  according  to  the  rules  of  logic  and  gram¬ 
mar 

Number  reasoning 

The  ability  to  recognize,  combine,  separate,  and  ma¬ 
nipulate  numbers  according  to  the  rules  of  arithmetic 
and  mathematics 

Manual  dexterity 

The  ability  to  use  one’s  limbs  (hands,  r’et,  etc.)  in  a 
smooth,  coordinated,  error-free  manner  to  manipulate 
objects 

Selective  attention 

The  ability  to  concentrate  attention  on  a  single  stimulus 
in  the  presence  of  distractors 

Coding 

The  ability  to  convert  information  from  one  form  or 
mode  to  another 

Short-term  memory 

The  ability  to  keep  a  piece  of  information  in  mind  and 
recall  it  exactly  for  a  short  time 

Timesharing 

The  ability  to  perform  multiple  activities  at  the  same 
time 

Long-term  memory 

The  ability  to  learn  and  recall  information  for  a  longtime 


ATC  Example 

Scanning  PVD  and  using  aircraft  tracks  to  identify 
potential  conflict  situations 


Understanding  pilot  request  for  altitude  change  due  to 
air  turbulence  at  the  assigned  altitude 


Computing  the  estimated  time  of  arrival  for  a  general 
aviation  aircraft  from  filed  airspeed  and  distance  to  be 
traveled  on  route 

Slewing  the  cursor  onto  a  target  using  the  trackball 


Listening  to  a  single  aircraft’s  transmission  against  back¬ 
ground  noise 

T ranslatinga  heading  reported  by  a  pilot  into  the  aircraft’s 
track  on  a  graphic  display 

Saying  a  clearance,  keeping  it  in  mind  while  the  pilot 
reads  it  back  and  comparing  the  readback  to  what  was 
said 

Saying  a  clearance  while  writing  the  clearance  on  the 
strip  at  the  same  time 

Recalling  aircraft  performance  characteristics  learned  in 
follow-on  training  three  years  ago 
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